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Abstract 

We prove that weakly continuous solutions to martingale problems 
admit a canonical regular conditional probability distribution. This al- 
lows for the construction of time consistent convex dynamic procedures 
in a non dominated setting. Making use of the martingale problem ap- 
proach for continuous diffusions and diffusions with Levy generator, we 
give an explicit construction of such procedures having furthermore a 
Feller property. 

These procedures lead to viscosity solution of fully non linear second 
order partial differential equations in case of continuous diffusions. In 
case of diffusions with Levy generator this provides a probabilistic ap- 
proach for the resolution of non local fully non linear second order 
PDE. 

Keywords: Time consistency, convex duality, Feller pro- 
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1 Introduction 



Starting from the solution of the non linear heat equation, Peng [271 [28] has 
introduced the notion of G-expectation (£^)t£M + which is a sublinear time 
consistent dynamic procedure denned on continuous functions on 0. The 
state space f2 is there equal to the set of continuous paths, and £f(X) is 
defined by a stepwise evaluation of the partial differential equation (PDE). 
Denis at al [12] have then proved that £(f(X) = suppe g -p E P e(X), where V 
is a weakly compact set of probability measures which are non dominated 
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(i.e. there is no probability measure P such that Q <C P for all Q in V). The 
properties of (£f)teM + ar e up to a minus sign the properties of a sublinear 
time consistent dynamic risk measure. Since the seminal papers of Peng 
on G-expectation, a new challenge is to develop a theory of time consistent 
dynamic procedures in a non dominated framework, and also to provide 
viscosity solutions to fully non linear second order partial differential equa- 
tions. 

Some recent works study the properties of these procedures, in the static 
case [6] and in the dynamic case [251 E]- Other works construct time consis- 
tent dynamic procedures. The first construction of G-expectation by Peng 
[271 128] was made on the state of continuous paths from the non linear 
heat equation -d t v(t,x) - G(D 2 v(t,x)) = 0, G(A) = sup 7ee Tr (77M) (9 
bounded) with boundary condition v(0, x) = f(x). Starting from the unique 
viscosity solution of a second order PDE containing a non local term, this 
construction has been extended in [18] to produce a time consistent sublin- 
ear procedure on the set of cadlag paths. In both cases G is independent of 
t and x and the G-heat equation corresponds to diffusions with no drift and 
a diffusion coefficient varying between two bounds. These works of Peng et 
al. have motivated other works constructing time consistent dynamic proce- 
dures on the set of continuous paths, in a non dominated framework. Nutz 
has produced time consistent sublinear procedures allowing the G coefficient 
to vary with both t and x (or equivalently with u in the non Markovian case) 
in [23], or allowing both the diffusion coefficient and the drift term to vary 
between bounds [24] ■ In both cases the construction is made to by to. Start- 
ing from a given set of probability measures for all t and u, satisfying some 
compatibility conditions and analytic properties, Nutz and van Handel [26] 
construct also sublinear time consistent procedures on the space of contin- 
uous paths. Soner et al [301 EI] have constructed convex (and not only 
sublinear) time consistent dynamic procedures in the setting of diffusions 
as well. Their approach makes use of a solution of a Backward Stochastic 
Differential Equation (BSDE) associated to every probability measure in the 
set V and then solves an "aggregation problem". The diffusion coefficient 
varies in a domain independent of t and x. In [31] it is proved that this 
construction gives rise to viscosity solutions to fully non linear second order 
PDE. 

Time consistent dynamic procedures on a filtered probability space or up 
to a minus sign dynamic risk measures have been studied in many papers 
[31 H10 Dill [20]. Risk measures are characterized by their dual representation. 
In particular, in the static case [13 US], po.tPO = su PQg-p(^Q( — X) — a(Q)) 
where V is a set of probability measures all absolutely with respect to P. 



2 



Sublinear time consistent risk measures are fully characterized by a stable 
set of probability measures [TO]. Convex time consistent dynamic risk mea- 
sures are described by a stable set of probability measures V and a local 
penalty denned on V satisfying the cocycle condition [3J H] . In the partic- 
ular case of the Brownian filtration, time consistent dynamic risk measures 
are limits of solutions of BSDE [11] . 

In order to generalize the construction of time consistent dynamic proce- 
dures to the case of non dominated probability measures, the main point is 
to understand the notion of stable set of probability measures in this new 
framework. Indeed the usual notion of stable set involves Q-conditional 
expectation. However Q-conditional expectation is defined up to a Q-null 
set and this is a drawback when one considers non equivalent probability 
measures. On a Polish space O, for all sub a- algebra B of the Borel a 
algebra, there exists always a measurable version of the Q-condition ex- 
pectation called regular conditional probability distribution given B ( [36] . 
Theorem 1.1.6.). However there is no unicity of the Q-regular conditional 
distribution given B. In order to extend the notion of stability by bifurca- 
tion [3] to a set of non dominated probability measures as well as the local 
condition for a penalty [3], one needs to be able to make a coherent choice 
for a measurable version of the conditional expectation. 
The first goal of the present paper is to prove that weakly continuous so- 
lutions to a martingale problem (Sectior(2]) is a very nice setting in which 
there exists a canonical version of the conditional expectation (Section [3]). 
This allows to extend the notion of stability to a set of probability measures 
which are non dominated (Section H]). This canonical version has further- 
more continuity properties (Section[5]). Specializing to the case of continuous 
diffusions or to the case of diffusions with Levy generator, we then construct 
penalties having a Feller property (Section [7J), satisfying the local condition 
and the cocycle condition. The canonical version of conditional expecta- 
tion joint with the Feller penalties give a generic and constructive method 
to produce T-time consistent convex dynamic procedures on the space of 
continuous paths and also on the space of cadlag paths in a non dominated 
framework. The set T can be any subset of in particular it can be ]R* + 
or a discrete subset of M+. This construction generalizes to the non domi- 
nated framework the construction of [5]. It can be used to construct a great 
variety of time consistent dynamic procedures in non dominated framework. 
In the case of continuous paths, the underlying set of probability measures 
V is a "stable set" generated by probability measures solution to a martin- 
gale problem associated to a continuous diffusion with diffusion coefficient 
a(t, x) and drift coefficient b(t, x) continuous bounded , a(t, x) invertible for 
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all (t, x) such that (a, b) takes values in a multivalued Borel set. In the case 
of cadlag paths, the underlying set of probability measures V is the "stable 
set" generated by probability measures solutions to a martingale problem 
associated to diffusions with Levy generator with coefficients a(t, x) b(t, x) 
satisfying the above conditions and the jump measure M(t, x) satisfying 
the hypothesis of [32], (a,b,M) taking values in a multivalued Borel set. 
The procedure is defined on the closure (for the norm sup Pe p Ep{\X\) of 
the lattice vector space of continuous coordinate functions f(X tl ,..X tk ) (/ 
continuous on (M n ) k ) and also on the cone f(X tl , -Xt k ), where / is lower 
semi continuous bounded from below. A construction for a time consistent 
procedure on cadlag paths is independently proposed in [19], but within 
a very limited and specific framework: the set of probability mesasures is 
generated by probability measures solutions to the martingale problem asso- 
ciated to diffusions with Levy generator where there is no drift, the diffusion 
coefficient and the jump measure depend only of t (not on x), there is no 
multivalued Borel mapping, and no penalty function. Furthermore the pro- 
cedure is defined on the uniformly continuous functions on the space of 
cadlag paths, which does not allow to study PDEs in the context of cadlag 
paths. 

Our last goal is to prove as in [5] that these procedures give a new prob- 
abilistic approach to second order PDE (Section [9|). Indeed, in the case 
T = M + , these procedures applied to the random variable h(X t ) (h lower 
semi-continuous bounded from below) give rise to a time consistent con- 
vex Feller process h(s,X s ). The function h is lower semi-continuous on 
[0,t] x M n . Making use of the martingale property of the probability mea- 
sures, we prove that this lower semi-continuous function is a viscosity su- 
persolution of a second order PDE: 

^ — d u v (u, x) — f(u, x, Dv (u, x), D 2 v(u, x), Kv (u, x)) = 

v(t,x) = h(x) 

(1) 

The non local term Kv(u,x)(y) = v(u,x + y) — v(u,x) — ^^tuttI^ is spe- 
cific of the case of diffusions with Levy generator. In case of continuous 
diffusions / depends only on (u, x, Dv(u, x), D 2 v(u, x)), the PDE is a fully 
non linear second order partial differential equation. In this last case, our 
results can be compared to those of [31] . In [31], the function / can also 
depend on v but there are restrictive conditions on the dual of / which are 
not needed in our approach. This is due to the fact that the construction 
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in [31] relies on the existence of solutions to BSDE and also on the aggre- 
gation of these solutions. On the contrary in the present paper we have 
an explicit construction of the time consistent procedure. Furthermore the 
stability property of the set of probability measures and the conditions on 
the penalties imply the time consitency for the procedure (Section [U]). As 
mentioned in [5], the time consistency for the procedure corresponds to the 
usual dynamic programming principle. Notice also that our probabilistic 
approach can be considered as a general control problem, where the set of 
control is a set of non dominated probability measures. As in [5], under 
some conditions the function h is continuous and is a viscosity solution of 
the PDE. 

2 Martingale problem 

We fix a finite horizon T. In the following for r < T, the state space ST r is 
either the set C([r,T], M n ) of continuous paths on [r, T] endowed with the 
topology of uniform convergence, or the set T>([r,T] of cadlag paths with 
the Skorokod topology |2j. Recall that fT is a Polish space i.e. a complete 
separable metrizable space [2]. 

In both cases (X t ) t ^]R+ denotes the coordinate process, and B\ is the a- 
algebra generated by {X u , r < u < t}. 

2.1 Diffusions with continuous coefficients 

As in [5] we consider the martingale problem introduced in |33| . In this sub- 
section the state space is the set of continuous paths, VL r = C r = C([r, T},M n ). 
Let a : [0,T] x M n ->• M n {M) and b : [0, T) x M n -> M n be continuous 
bounded maps such that for all (t, x), a(t,x) is definite positive (i.e. a is 
strictly elliptic). For given £ M n let 

Y r a /{6) = exp{6*(X{t)-X{r))- J 6*b(u, X(u))du-^ J 6*a{u, X{u))9du} 

(2) 

Following |33| one says that the probability measure Qr] y on (£l r ,B r ) is a 
solution to the martingale problem (|2|) starting from y at time r if for all 6 6 
M n , (Yri b (9))t> r is a martingale on (ST, (B r ) t )t>r, Qr'y), and if Qrly({X r = 
*/}) = !• 

Denote C^°(JR n ) the set of C°° functions with compact support. Denote 
L t ,b = \ Za aij(t,x) 9x 9 9x , +Y,ibi{t,x)- d ^-. From [35] Theorem 2.1, the 
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above martingale problem is equivalent to 

= f(Xt)-f{X r )- J L% b (f)(X u )du is a Q^-martingale for all f in C c °°(iR n ) 

(3) 

The study of the martingale problem has been extended in |32] to the case 
of diffusions with Levy generators. 

2.2 Diffusions with Levy generators 

In this subsection Q r is equal to V r = V([r, T],M n ), the set of cadlag paths 
endowed with the Skorokod topology [2]. 

Definition 2.1 Hypothesis (M) 

A Borelian map M defined on 1R + x JR n with values in the set of a -finite 
measures on ]R n — {0} satisfies hypothesis (M) if for all Borelian subset A 
ofM n -{0}, 

;M(s, x, dy) is continuous bounded (4) 
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Let Kj™ be the operator associated to M: 

K t M (f)(x) = [ [f(x + y) - Six) - tl^h M {t, x, dy) (5) 

J 1 + \\y\\ 

Recall the following result from [32], Theorem 4.3. 

Proposition 2.2 For all a and b continuous bounded and a strictly elliptic, 
for all M satisfying the hypothesis (M), for all r in iR + and all y in JR n , there 
is a unique probability measure Qr'y' on (T> r , B r ) solution to the martingale 
problem 

z a,b,M = f{Xt) _ f[Xr) _ /" (L „,6 + K M )[f){Xu)du V/ g coo^n) (g) 

J r 

starting from y at time r i. e. such that Qr',y M \{X r = y}) = 1 
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2.3 Weakly continuous solution to a martingale problem 

Motivated by the above martingale problem both for continuous diffusions 
and for diffusions with Levy generators, we consider in the following so- 
lutions to a martingale problem in a general setting. A finite horizon T is 
given. The state space can be either the set of continuous or of cadlag paths. 

Definition 2.3 For all s € [0, T[ and y € M n , let Q s ,y be the unique solution 
to the martingale problem Z on (£l s ,Bj>), starting from y at time s. (Z 
means a whole family {Z 1 ')^. 

• (Qs,y)y£iR n is weakly continuous 

if Q sy is a continuous function of y for the weak topology. 

• The martingale problem is additive if for all i £ I, for all < r < s < 
t, Z\ s is B r s measurable, Z\ is a right continuous function of s, and 

• The martingale problem is bounded if for allO < r < s, Z % rt is bounded. 

Definition 2.4 Hypothesis H® 

is a set of Borelian maps defined on M. + x M n with values in a topo- 
logical space E such that 

1. for all 9 G 0, for all < r < t < T and for all y in M n , there is 
a unique probability measure Q® y on B[) solution to the additive 
bounded martingale problem Z 9 starting from y at time r. 

2. for all G 0, and r < T , (Qf,y)yeK n * s weakly continuous. 

Continuous diffusions and diffusions with Levy generators provide examples 
for 0: 

Proposition 2.5 The notations are those of Section \2.1\ Let a and b be 

continuous bounded on ([0, T] x M n ) such that a(s,x) is invertible for all 
(s,x). Let Zy\ be given by equation (TJp. The unique solution Qr',y on 
(C r ,B^ r ) to the additive martingale problem Z^f starting from y at time 
r is weakly continuous. 

= {(a, b) continuous bounded, a invertible} (8) 

satisfies hypothesis Hq. 



7 



Proof The weak continuity follows Theorem 7.1 of [S]). See also Proposi- 
tion 2.6 of [5] for a detailed argument. It follows easily from the definition 
that Z®f is additive and bounded for all / in C^°(M n ). □ 
For diffusions with Levy generators we introduce now another hypothesis. 

Definition 2.6 Hypothesis M c . The map M with values in a finite mea- 
sures on M n — {0} satisfies hypothesis Mq if it satisfies hypothesis M and 
*f 

sup f [|M| 2 l |l2/ ||<i + \\y\\l M>1 ]M(s,x,dy) < C (9) 

s,x J 

The following Lemma is proved in |22| (cf the proof of Theorem 20) . 

Lemma 2.7 Let A, B, C, D be strictly positive. For all e > there is K > 
and for all e, rj > 0, there is h > such that for all < r < T, for all a 
continuous strictly elliptic bounded by A for all b continuous bounded by B 
and M satisfying hypothesis Mc, and \ \y\ \ < D, 

Q a r ' b ' M [ sup |pq| >K] <e (10) 

r<v<T 

Vn G [r, T] , Q^/ 1 [ sup | \X V - X u \ \ > V ] < e (11) 

r<u<v<inf(u+h,T) 

Notice that for given r and y, the above Lemma implies the relative weak 
compacity of the set of probability measures Qr]y satisfying the above con- 
ditions. The equation (jlip is a "uniform right convergence". This property 
is stronger than the property needed to prove the relative weak compacity 
(Theorem 13.2 of [2j). In particular it allows to prove the following propo- 
sition. 

If s n > s, the probability measure Qs'n'y^. on ^ Sn can be identified with 
a probability measure on $7 S still denoted Qs' n ,'y n such that Qs' n ^ y „ ({X u = 
y n , Vs < u < s n }) = 1. 

Notation 2.8 Let 0<r<s<t<T. 

• Denote tvT t j the canonical projection of £l r = £1^ onto Slf . 

"[.,(|( w ) = W IM ( 12 ) 

• In case r = s the projection irj will be denoted simply 7r[ 
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Proposition 2.9 Let a be continuous strictly elliptic bounded by A, b con- 
tinuous bounded by B and M satisfying hypothesis Mq- Assume that (s n , y n ) 
has the limit (s,y). Then 

1. - If s n is decreasing to s, with the above identification, Qs'^yn converges 
weakly to Qs',y ■ 

- If s n is increasing to s, the image ofQs„^ by ir s ^ T ^ converges weakly 

to Qs,y 

2. For all (t%, ...,tfc), s < t\ < ... < t^ < T, for all f continuous bounded 
on (M n ) k , QS(/(I tl) ..,I ( J) has the limit Q a s % M {f{X tl , X tk )). 

Proof 

Prom Lemma [221 and from Theorem 13.2 of [2]), it follows that 
{Q a styl, n G IN} in case s n > s, ({(Qs'^)^^)' 1 , n G IN}) in case 
s n < s is relatively compact for the weak topology. The set of probability 
measures on (0, S ,B^) is metrizable for the weak topology, thus there is 
a subsequence converging to Q for the weak topology on Q s . As in 
Section 13 of [2] denote Tq the set of t G [s, T] for which the projection 
IT : uj G VL S — > uj(t) is continuous except at points forming a (J- null set. It is 
proved in Section 13 of [2] that s, T belong to Tq and that the complement 
of the set Tq in [s, T] is at most countable. 

1. Step 1. We prove that equations (fTUj) and (fTTI) are also satisfied by 
Q for r = s. Notice that the weak convergence of Qk to Q means 
that Qk{f) has the limit Q{f) for continuous functions / but this 
convergence is not valid for general Borelian functions. Let Tq be an 
increasing sequence of finite subsets of Tq containing s and T such 
that UjTg is dense in [s,T]. It follows from the Mapping Theorem 
(Theorem 2.7. of [2]) and the inequality R(G) < liminf for all 

open set G and every sequence Rk weakly converging to R, that for 
all i, 

Q[ sup \\X v \\>K]<e (13) 

s<v<T, veT^ 

VuG [s,T]nf Q) Q[ sup \\X V - X u \\ > rj] < e (14) 

u<v<{inf(u+h,T), v£T^ 

It follows from the monotone convergence Theorem that one can re- 
place in the above equations Tq by UjTq. Equations (fl~0|) and (fTTI) 
follow then for Q making use of the density of UjTg in [s,T] and of 
the right continuity of X v for all v. 
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2. step 2: We prove that for all (ti,...,ti), s < t\ < ... < ti < T, for 
all / continuous bounded on (]R n ) 1 , Qk{f(X tl , X tl ) has the limit 
Q(f(X tl ,...,X tl )). 

From [2 J Section 13 this is true for allii, ti, in Tq, s <t\ < ... < ti < 
T. The set Tq is dense and contains s and T, thus for all U = .., t{) 
there is a sequence U 3 = {t\, ..tj) of /-uplets Tq valued decreasing to 
U. The function / being uniformly continuous on compact sets, it 
follows from equations (fit)]) and (fTTj) satisfied for all Qk and Q, that 
for all n, for all j > J, all k, Qk(\f(X h , X tl ) - f{X^,...,X^\) < e 
and Q ( I / (X t , . . . , X t ) — / (Xj , X j ) I ) < e. From the convergence of 
Qk(f(X t j,...,X t .j) to Q(f(X t j,...,X t j)), we then get the result. 

3. Step 3. Let s < t < T. Let Z^ M be given by equation ([U]) for some 
function / C°° with compact support. It follows from hypothesis Mc 
that the function (u,x) e [0,T] x M n ^ L^\f)(x) + K^(f)(x) is 
continuous bounded. A similar argument as the above one proves 
that for all e > 0, there are s < s\ < ..s p < T and a contin- 
uous bounded function g S)t on (M n ) p such that for all Q and Qk, 
Q k (\Z:p M -g s , t (X Sl ...X Sp )\ < e, and Q(\Z a s f M - g 3 , t (X Sl ...X Sp )\ < e. 
Making use of the martingale property of [Z a s \ ' ) s <t<T for Qj~ it fol- 
lows that (Zg' t ' ) s <t<T is a martingale for Q. 

4. step 4. Qfc is weakly converging to Q on s . X s is continuous on 
Q s , thus for all rj > 0, — y|| > 77} is open. It follows that 
Q({\\X S -y\\>rj})< liminf - y\\ > r?}). 

-If s n < s, Qk is the image of Qs' n 'y n , - let e, 77 > 0. Let h such that 
equation (fTT]) is satisfied for all Qsn'*y n . and Q. Let fc such that for 
all k > ko, \s nk — s\ < h and \\y— Vn k \\ < V- ^ follows from (fTTj) applied 
with Qs'^ nk ,u = s nk &ndv = s that Qs'^y^ ({\\X s -y\ \ > 2r]}) < 2e. 
Q is the weak limit of Qs'n k ^y nk W^V]) -1 ) an d s belongs to Tq, it follows 
that Q({X S = y}) = 1. 

- If s n is decreasing to s, Qfc = Q a st k ^y nk ■ Let e > 0, for k large enough, 
Qfc({|X s — y\ > e}) = 0. In both cases this proves that Q = Qs',y M - 

□ 

Proposition 2.10 Let a and b be continuous bounded on ([0, T] x M n ) such 
that a(s, x) is invertible for all (s, x). Assume that M satisfies the hypothesis 
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M c . Z a r 

t ' given by equation f6j) is bounded. The unique solution Q r \y 

on {T> T ,BTp) to the additive martingale problem Z^f ,M starting from y at 
time r is weakly continuous. The set 

= {(a,b,M) a,b continuous bounded, a invertible, 

M satisfies hypothesis Mc for some C > 0} (15) 

satisfies hypothesis H®. 

Proof The existence and unicity follow from [32J . The weak continuity fol- 
lows then from Proposition 12.91 applied with s n = r for all n. As already 
noticed in step 3 of Proposition 12.91 for all / E C£°, and all s < t, Zg' t ' is 
bounded. □. 
Ths weak continuity for given r can also be found in [13] Lemma 5.2., but 
there is no detailed proof. 



3 Canonical representation of the conditional ex- 
pectation for the weakly continuous solution to 
a martingale problem 

Let < r < s < T. The state space Q r T is either C([r, T],M n ) or V([r, T],]R n ). 
The goal of this Section is to prove that in the setting of weakly continuous 
solutions to martingale problems, there exists a canonical choice for a regu- 
lar conditional probability, and that this choice satisfies nice properties. 



3.1 Unicity of the solution to a martingale problem for non 
Markovian parameters 

Let O be a set of parameters satisfying Hypothesis Hq (Definition 12. 4p . 
Given r E [0,7"] and y E M n , we introduce the following stable set of 
parameters: 

Definition 3.1 Let < r < T. 0^ denotes the set of W T predictable pro- 
cesses 7 on (Q t ,Bt) such that: 

There is a finite subdivision r = so < s± < ... < s n = T. 

For all i E {0, 1, ...n — 1} there is a finite set l{, Iq = {1}, a finite partition 

(Aij)j£j i of Q r into B r s .- measurable sets, and 9q, (Gi,j)jeh ^ ® such that 

Vsj < u < s i+ i, Vw E U r , j(u,uj) = y~] 9jj(u, X u (u)))l Ai . (u) (16) 
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We define the associated martingale: 

Definition 3.2 For all 7 in 0^ admitting the above representation, denote 
(Zr )U )r<u<T the additive process (Z?, v = %r,u + Zu,v for r < u < v < T) 
defined by 

Vsi < u < s i+1 , Voj € tt, Z] uU {u) = ^2 Z s l%(u)l Ai>j {ui) (17) 

Lemma 3.3 Assume that Qr, x is a solution to the bounded additive mar- 
tingale problem (Z^! t ) r < t <T starting from x at time r ( Definition \2.3\) . Let 
(Qr,x) s,ul be a regular conditional distribution of Q7,x given B r s . There is 
subset N ofttj, such that for all oj € $7^ — N, (Qr,x) s,ul is solution on Qj, to 
the martingale problem (Z] t ) s <t<T o,nd (Qr,x) s ' u ({X u (oj') = X u (u)), Mr < 
u<s}) = 1. 

Proof Let s < u < v < t. For all B 6 B r u , there is a set N B such that for 
Ql x (N B ) = and for all oj £ — N B , 

(Ql x y>»(z2 iV -zi u )i B ) 

= E Qlx {{Zl v -Zl u )l B \BD) 
E QlS E QlM Z lv - Zl u )l B \B r u W s ) = (18) 

The (j-algebra W u is a Borel cr-algebra. Thus it is countably generated. Let 
Ak be a countable family of events including QL, generating B r u . It follows 
that there is a subset N of fl^ such that Qr, x {N) = and 

(Q7, X ) S ' U (Z7, V - zuo = (19) 

for all £ = lA k and all oj 6 fi^ — N. It follows from the dominated con- 
vergence Theorem and the monotone class theorem that equation f)19|) is 
satisfied by 1a for all A in B r u . Thus equation (fT9|) is satisfied for all ^ 
simple B r u measurable. Another application of the dominated convergence 
Theorem proves that it is satisfied for all £ bounded B r u measurable. We have 
thus proved that for all s < u < v < t, there is a set N U)V , Ql,x{N u ^ v ) = 
such that equation (fT9|) is satisfied for all £ bounded B r u measurable and 
all oj € Sl r T — N UjV . Let N = ^J u ,ve(Qn[s,T})u{s,T}N u ,v Making use of the 
rightcontinuity of the process {Zr )U )r<u<t for given r, equation (fT9|) follows 
for all s < u < v < t, for all £ bounded B r u measurable and all oj € £l T T — N. 
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Thus for all lo € £1^ — N(, Qr,x) s,0J is solution on to the martingale 
problem (Z] t ) s <t<T- By definition of a regular conditional distribution, 

{Q7,x) s '"({X u {u') = X u (lo), Vr < u < s}) = 1. □ 

Proposition 3.4 For all process 7 in 0^-,, /or all < r < t <T there is at 
most one probability measure on (Ql,B 7 t ) solution to the additive martingale 
problem {Z^ u ) starting from y at time r. 

Proof Let 7 in 0^ (Definition [3T|. The proof is done by iteration on n > 1. 
For tt. = 1 it is satisfied by hypothesis on 0. Assume that it is satisfied for 
n — 1. Let Q be a probability measure solution to the martingale problem 
{Zr )U ) on (Sl£',£?[) starting from y at time r. It is easy to see that the 
restriction of Q to B r s is solution to the martingale problem (^n)r<«<s n _i 
where 7 is the restriction of 7 to [r, s n _i[xJ7[. By recursion hypothesis, the 
restriction of Q to B r s is uniquely determined. Let Q 5 ™- 1 ^ be a regular 
conditional distribution of Q given . From Lemma 1331 for all j € Jn-ij 
there is a subset iVj of A n _ij such that for all lo € -A n -i,j — Nj, Q Sn - 1 ^ is 

solution to the martingale problem (Zs"Zt',v) Sn _ 1 <v<t- The function B n -\,j 
belongs to 0, thus from unicity of the solution to the martingale problem 
associated to 9 n -i,j starting from X Sn _ 1 (oj) at time s n _i, it follows that 
Qs n -i,w is uniquely determined for all to G -A n -l,j ~~ with Q(Nj) = 0, 
for all j 6 I n _i. Thus Q is uniquely determined. Therefore there exists at 
most one probability measure Q solution to the martingale problem {Zr )U ) 
on (Qt,Bl) starting from y at time r. □ 

3.2 Construction of a probability measure Q on (f2 r ,£>y) as- 
sociated to a non Markovian parameter 

For every Borelian function / on £l r s x fiy, for all lo in £l r s , f u denotes the 
Borelian map defined on Clj, by f u (oo') = f(oj,Lo'). 

Lemma 3.5 For given s, let {Q s ,y)y^iR n be the weakly continuous solution 
on (Q s ,Bji) to a martingale problem starting from y at time s (Definition 
\2.3\) . Then for all f Borelian bounded on tl r s x ttij,, the map 

n r s x M n -> M 

(co,y) Q s , y (n (20) 

is measurable when £l r s x M n is endowed with the Borel product a-algebra. 
When f is continuous on Vt r s x £l?p, the above map is furthermore separately 
continuous in each variable. 



13 



Proof 



Assume that / is continuous bounded. Being f w continuous, the map 

y -)• Qs, y (n (21) 

is continuous by hypothesis. On the other hand, Q StV being a proba- 
bility measure and / being continuous bounded, the continuity of the 
map 

W Qs,y(n- (22) 

follows from the dominated convergence Theorem. Thus the map 

(uj,y) ^ Q s , y (n (23) 

is separately continuous in each variable. The sets fi£ and Jl™ are 
metrizable and separable, it follows from Lemma 4.50 of [1J that this 
map is jointly measurable for the product Borel u-algebra. 

Let Ti be the set of bounded Borelian functions / on Q, r s x Vt?p such 
that the map (ui,y) —> Qs^yif^) is Borelian. % is a vector space 
containing the constant functions. If f n is an increasing sequence of 
non negative functions in C with limit / bounded, it follows from 
the monotone convergence theorem that Q s ,y(f u ) = lim n _;.oo Qs,y{fn)- 
It follows that / belongs to 7i. From the first step of the proof H 
contains the class C of continuous bounded functions. The class C is 
stable by pointwise multiplication. It follows from the monotone class 
theorem as stated in [29J chapter Theorem 2.2, that T~L contains all 



the bounded Borelian functions on £l r s x fiy. □ 

Corollary 3.6 For all f Borelian bounded on £l r s x flj,, the map 

n r s ^M (24) 

u^Q.,x.wV u ) (25) 

is Borelian. 

Proof The map u € W s — > X s (uj) € M n is Borelian, thus the corollary 

follows from Lemma 13.51 □ 
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Proposition 3.7 Let < r < s. Let J be a finite subset of IN. For 
given j £ J, let (Qi, y )y£]R n be a weakly continuous family of probability 
measures on Clip. Let (hj)j£j be non negative Borelian maps on M n such 
that \/y G M n , J^jeJ^j = 1- Let Q\ be a probability measure on {Q. r s ,B r s ). 
There is a unique probability measure Q on (p, r s x Q.?p,B r s x Sf,) such that 
for all f Borelian bounded on W s x Q.?p, 

Q(/) = E/ HX^Ql^indQiiu) (26) 

Proof For all / Borelian bounded it follows from Corollary 13.61 that the map 

T(f) :ueni ^Y. h ^ X ^))Qix s{ .)Un (27) 
jeJ 

is Borelian. It is also bounded. Thus J nr ^i(^s(^))Qg x (u))(f W )dQi(u>) 

is well defined. The map 

L:f^J2f HXs{u))Q{ Xs{u) {ndQl{u) (28) 

defines a non negative linear form on the vector space of continuous bounded 
functions on Q r s x Q^,. Let f n be a decreasing sequence of continuous bounded 
functions on x Clip converging to 0. From the dominated convergence 
Theorem, it follows that for all j and u, Q J s x , , (/£) is a decreasing bounded 
sequence with limit 0. Applying again the dominated convergence Theorem, 
it follows that L{f n ) is decreasing with limit 0. From Daniell Stone Theorem 
it follows that there is a unique probability measure Q on (Q r s x Oj,, B r s x Bj), 
such that for all / continuous bounded, equation (i26j) is satisfied. The 
equality (|26p follows then for all Borelian bounded function as in the end of 
the proof of Lemma 13.51 □ 

Definition 3.8 Denote Q the probability measure on deduced from Q 
by the Borelian map 

(w,u/) -> (29) 

where 

i(u,u')(u) = ui(u), forr <u<s 

= u'(u) + u)(s)-u)'(s), fors<u<T (30) 
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3.3 Canonical regular conditional probability for Q given B r s 

Recall that LT^ denotes the canonical projection from $7^ to Vt r s . (cf Notation 

Proposition 3.9 • For all Borelian bounded on Vtj,, for all to in VP T , 
let 

T a ty){u>) = J2 h ^ x s^MQXx^)(^ oi ) KH ) ( 31 ) 

The map T s (ip) defined on Clj, is B r s measurable. 

• For all Q, and all ip Borelian bounded, T s (ip) is a B r s measurable ver- 
sion of the Q conditional expectation of ij) given B r s . 

For all g B r s measurable, T s {g) = g. 

Proof 

• The map i is measurable for the Borel cr-algebras on both side, it 
follows from Lemma 13.51 that for every Borelian map ip on Oj,, the 
map 

Q r s x M n -> Ft 

(u,y) -> Qi^oiY) (32) 

is Borelian for all j. Notice that the map ix r s is measurable from fiy, 
endowed with the cr-algebra B r s into Q, r s endowed with its Borel a- 
algebra. Composing the above map (|32p with 

n r T xM n -> ft r s x M n 

(cj,y) -»■ «M,y) (33) 

it follows that 

Q r T xM n -> M 

(u,y) -> Qi y ((i>oi)<M) (34) 

is measurable for the cr-algebra product of B r s and of B(M n ). hj a 
Borelian map on M n and X s is B r s measurable, it follows that T s (ijj) is 
B r s measurable for all Borelian map ip. 
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• Notice that every B r s measurable function g defined on can be 
factorized g = g o -k t s for some g B r s measurable denned on W s . This 
result is deduced from the monotone class theorem ([29]) applied with 
the class C of functions f(X tl , X t . 2 , .., X tk ) ,k € IV*, / Borelian on 
(M n ) k , r < h < *2 < t k < s. For all co in ttJj, and uJ in 0,^, iv r s o 
i(7rl(oj), uj') = tt t s (oj). It follows that for all g B r s measurable, the map 
(g o i) 7r J( w ) is constant equal to g(uj). From the equality Y^jejhj = 1; 
it follows that for all g B T S measurable, T s (g) = g. 
T s (ip) factorizes, T s (ijj) = T s (ip) o i: r s where T s (ip) is defined on Cl r s by 

f s (V0M =Y J hj{X s {u:))^ s>Xa{u; poiY (35) 

From the definition of Q (Proposition [377] and Definition [378]), it follows 
that for all * B r T measurable , and g = g o -k t s B r s measurable defined 
on ily, 




From the equality T s (^) = T s (i/j) oW s , it follows that 

Q(T 8 y>)g)= I (~g)^)(fsW(^)dQ 1 (oj) (37) 

The map T s (ip) being B r s measurable, it follows from equations ([36]) . 
([55]) and ([3"T]) that T s (tp) is a B r s measurable version of the Q condi- 
tional expectation of ip given B r s . □ 

3.4 Existence of a solution to the martingale problem for 
non Markovian parameters 

The goal of this Section is to prove that for all 7 G (Definition 13. lj) , the 
martingale problem Z 7 introduced in Definition 13.21 has a solution. 

Proposition 3.10 The hypothesis are the same as in Proposition \3.7\ As- 
sume furthermore that Q 1 = Q\ x is the unique solution on Q r s to the (Zf) r < t 

martingale problem starting from x at time r. Assume that for all j G J, 

■ 

Ql, y is the unique solution on to the (Z t j ) s <t martingale problem start- 
ing from y at time s. Assume that there is a finite partition (Aj)j^j of Q r 
in B T S measurable sets such that for all j £ J, hj = 1a, • Assume that for all 
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j in J, (Qs,y)yeM n * s weakly continuous. The probability measure Q is the 
unique solution to the Z@ martingale problem starting from x at time r with 
P(u, x) = 8(u, x), for all r < u < s and f3(u,x) = Y2jej^Ajdj(u,x), for all 
s < u. 

Proof 

• Let s < t < u < T. By definition of j3 and the additive property of 
the martingales, Z^ u - Z^ t = Z^ u = J2je,J l Aj(Z^u - Z^ t ). For all 
to in Q T S and uj' in Qj,, such that X s (uj) = X s (uj'), for all s < v < T, 

i(uj,uj')(v) = uj'(v), and [(Z% - Z%) o = [Z% - Z%)(uj'). 

Notice also that for all ip B\ measurable and all to in O^, the map 
(-0 o i) w is measurable. Thus for all if) S[ measurable 

i Aj (x s (u))Q^ Xs{ui) [mz^ u - zfy o in 

= U.(X s ( W ))Q^ aH [l {a)1 jr. (w)= x, (w0} (V ° if\(Z% ~ Z%) ° *"H 

= l^(X 8 (w)Qj >Jf<(w) [(^ o ,)-(Z s % - Zj)](38) 

(•^ s J t )s<t<T is a martingale for all y, it follows that the last term 
of (f38j) is equal to 0. It follows then from (j38|) and the definition of Q 
(Section I3.2p that Z^ t is a Q martingale for s <t <T. 

. Let r < t < u < s. Z^ u - Z% = (Z°. u - Z%) = (Z% - Z^ t ) o (<). 
Let ip be a function 23[ measurable on O^, t/j = if) o (7rJ), where ?/> is 
a function B£ measurable defined on Q£. Being ip and — Z^ t B r s 
measurable, it follows from the second part of the proof of Proposition 
EH that Q(1>(Z?, V - Z* t )) = Qi$(Z° tV - Z£ t )). Being (Z e r t ) r < t < s a 
Qi martingale, it follows that Z^ t is a Q martingale for r < t < s. □ 

3.5 Canonical regular conditional probability 

Notation 3.11 For all r < s,foralluj € fi^ andoj' £ Of such that X s (cj) = 
X s (uj') we denote uj * uj' the element of £l r T such that 

uj*uj'(u) = uj(u) Vr < u < s 

uj * uj' (u) = uj'(u) Vs < u < T (39) 
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Proposition 3.12 1. Let r > and y in M n . Let 6 G 6. For all 

s € [r,T[ and all bounded map ip Bj, -measurable defined on Vt r , the 
map T°{tp) defined on fl r by T%{ip){u) = Q% Xs{uj) {{^ o *)<H) i s a 
B r s -measurable version of the Q® - conditional expectation of tp given 
B r s . We call it the canonical regular conditional distribution of Q e r y . 

2. 

Tf^)M = 0j A(w) ((^o (40) 
^(w * ^)lx s ^)=x s ^)dQ% Xs(u)) {^') (41) 

5. satisfies the following chain rule for all map (ft B^ -measurable de- 
fined on Q r ° , 

Vr <r<s<T, T r 9 (0) = T e r {T e s {eft)) (42) 




Proof 

1. Apply Proposition 13.101 with Qi = Q 6 ry , J = {j}, and Q 3 S)X = Q StX - 
It follows that the probability measure Q satisfies the Z d martingale 
problem on f2£, starting from y at time r. By unicity of the solution 
to the martingale problem it follows that Q = Qr >y - The result follows 
then from Proposition 13.91 

2. It follows immediately from the definitions of i, H r s and * that 

1{x s h=x s ^)}(^ ° if^V) = hx s{ .)=x a ^)}^ * u/) (43) 
The equation (J3JJ) follows then from Q e s>Xs(fJj) 0-{x s (u)=X s (tj')}) = 1 

3. Let Q be as in 1.. From the definition of Q, Definition 13. 8^ equations 
(f26|) and ([IT]) it follows from the equality Q = Q 6 r y that for all function 
ift ^-measurable defined on J7 r , 

/ = / I / V^l*^ 2 )l 

X s (U}\)=X S (U!2) 

(44) 
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Let B T rp measurable denned on fT°. Let uj £ Applying the 

above equation to the function tp defined on £l r by ip(u)') = 4>(uj * 
LjJ ')^{x r (u))=x r (u)')}i it follows from equation (|4ip that 



/ lx r H=x r K* W2 )^ XrH (wi)[ / 0(w * wi * ^Ixsi^Xs^dQlx^)^)] 

l X r (uj)=X r (wi )T| (0) 

(wi)(45) 



This proves the chain rule equation (|42|) . □ 

Theorem 3.13 Let < r < T. For a// 7 € 0^ and y in Ei n , there is a 
unique solution to the martingale problem Z 7 on (f2 r ,Bj>) starting from y 
at time r. We denote it Qr,y Let r < s < T . Consider the expression of 7 
as in Definition \3.1\ For all r < s < T, let i such that Si < s < s^+i- For 
all ijj defined on f2 r bounded Bg measurable, the map (ip) defined as 

W) = ^U,.T^' J '(V0 (46) 

is B r s . measurable. The map T] admits a unique extension to all bounded 
B r T measurable functions such that the chain rule is satisfied: 

Vr<s<t<T, = (47) 

r7(V ; ) is a B r s measurable version of the Qr,y conditional expectation of ip 
given B r s . It is called the canonical regular conditional distribution of Qr,y 
given B r s . 

Proof For given r and y the existence of Qr, y follows by induction from 
Proposition 13.101 The unicity follows from Proposition 13.41 Let Sj be as 
subdivision asociated to 7 as in Definition 13.11 Let s, < s < Sj+i < T. 
Consider the probability measures Q constructed on from Qr, y on fl r s 

and from ^ 1^ . (oj)Q* x , x on Vt?p as in Section I3T21 From Proposition l3.10l 

it follows that Q solves the martingale problem for 7 on Q r Si+1 starting from 
y at time r. From the unicity it follows that the restriction of Qr, y to B r s 
is equal to Q. From Proposition 13.91 equation (f3Tj) and equation (|4"0|) . it 
follows that for all ij) B^ measurable, T2(tp) defined by equation (|46f) is a 
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B r s measurable version of the Q- conditional expectation of ip given B r s . It 
is thus also a B r s measurable version of the Q7,j/-conditional expectation of 
ip given B r s . 

Making use of the chain rule for T , Proposition 13.121 it follows that Tg 
admits a unique extension to all B^ measurable functions such that the chain 
rule (|47p is satisfied. It is given by a stepwise evaluation: for Sj < s < Sj+i, 
T](ip) = Tg (Ts i+1 (.-.Ts' n _ l (il!)). The result follows then by induction. □ 

Corollary 3.14 1. Let r > 0, for all 7 S Qj,, and r < s < T , the non 

negative linear map T] is continuous from below. It can be uniquely 
extended to the Borelian functions bounded from below by the formula 

T] (VO = limn^T] (V A n) (48) 

This extension is continuous from below. 

2. Equation ( resp ) is still satisfied for random variables bounded 
from below, for all 9 G G (resp 7 € @j>)- 

3. Ts(ip) is a B r s -measurable version of the Q7,y- conditional expectation 
of tp given B T S . 

4- The chain rule is satisfied for all function tp B T T -measurable bounded 
from below, 

Vr<s<t<T, 17 (VO = T7( T tW) (49) 

Proof The continuity from below for T~, 6 E follows from equation 
(|4ip and from the monotone convergence theorem applied to the probability 
measure Q® x / ^ for given oj. It follows for general T$ from the formula 
(|46p . The other statements follow from the continuity from below of T$ 
and from the monotone convergence theorem for probability measures (or 
for conditional expectations to prove 3.). □ 
We are now able to give a definition of a stable set of probability mea- 
sures for probability measures which are non dominated by some probability 
measure. 

4 Stable set of probability measures and penalties 

We concentrate now on the non dominated framework. As already noticed 
the usual definition of a stable set of probability measures cannot be used 
because the Q-conditional expectation is defined up to Q-null set. The exis- 
tence of a canonical choice for the regular conditional probability is crucial 
in the construction of dynamic procedures in non dominated setting. 
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4.1 Stable set of probability measures 



Let < r < T. Let £l r be C r or T> r with the canonical filtration. For 
all r < s < T, denote (Bb) r s the set of bounded functions defined on O r , 
immeasurable. Let T be a subset of [r,T]. 

Definition 4.1 A set Q of probability measures on {Vf ,B^j) is T stable if 

1. Special choice of a regular conditional distribution 

For all Q £ Q for all r < s < T s £ T , there is a non negative 
linear map continuous from below : {Bb) r T — > (Bb) r s such that for 
all i[> € {Bb) r T , Tg(ip) is a version of the Q-conditional expectation of 
tp given {B h ) r s . 

2. Chain rule 

For all map ip in (Bb)j-, for all s,t in T, s < t 

T? W = Tf (T^W) (50) 



Stability by composition 

For all Q and R in Q, for all s G T there is a probability measure S 
in Q such that 

Vs < u < T, T$ = T* 

\/r <u < s,\/4> e (B b y s , r u s (0) = r«(0) (51) 



4- stability by bifurcation: 

for all s 6T for all Q and R in Q, for all A C £V , A G B r s , there is a 
probability measure S in Q such that 

Vs<u<T, T M 5 = 1 A T U Q + l A cT* (52) 



In all the following to simplify the notations we assume that T = [r, T] . 

Theorem 4.2 Assume that satisfies hypothesis H® (Definition \2.4\ )- 

Let < r < T and y in JR n . Let 0^ be the set introduced in Definition 
GQJ The set 

Q?, y = {Qly,ie& r T } (53) 

is a stable set of probability measures. 

More precisely, let Q = Qj :V and R = Q & r y in Qf y - 
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i) Let \{u,uj) = j(u,U)) for all r < u < s and X(u,uj) = 5(u,co) for all 
s < u < T. The probability measure S = Q^ y satisfies \51\) . 

ii) Let r/(u,uj) = ^{u,uj) for all r < u < s and rj(u,uj) = 1a(uj)^(u,uj) + 
1a c 0~(u,uj) for all s < u < T. The probability measure S = Qr, y satisfies 

O 1 -v 

Proof For 7 € ® r T and r < s < T, let T s r ' y = Tg ■ It follows from Corollary 

Ql 

I3.14l that T s r ' v is linear non negative and continuous from below. Properties 
1. and 2. follow from Theorem 13.131 

- Proof of property 3. The process A defined in i) belongs to 0^ and from 
Theorem [3TT3] there is a unique probability measure Q^ y solution on (fT, Wj) 
to the martingale problem associated to A starting from y at time r. It fol- 
lows also from equation (|46|) and the chain rule that for all r < u < v < T for 
all tp defined on fT B r v measurable, the B r u measurable map X^(^) depends 
only on the restriction of A to [u,v[. This end the proof of the stability by 
composition. 

- Property 4- is proved in the same way considering the process r\ defined 
in ii) □ 

As in [5] we can furthermore consider a multivalued Borel mapping T from 
M + x M n into E (definition 2.8 of [5J). For all (t,x), T{t,x) is a subset of 
E containing 0. Let 9(r) = {6 G 6 \9(t,x) E T(t,x) V(t,x)}. We then get 
the following corollary 

Corollary 4.3 Assume that satisfies hypothesis H®. For all multivalued 
Borel mapping T, the set 

Q e (r) n2/ = {Q^, 7 ee(r)^} (54) 



is a stable set of probability measures, 
measures generated by @(r). 

4.2 penalties 



We call it the stable set of probability 



We want to construct time consistent dynamic convex Feller procedures, 
(and not only sub linear). Therefore as for the construction of time con- 
sistent dynamic risk measures on a filtered probability space, we need to 
introduce penalties satisfying some properties ([3]). To encompass the non 
dominated framework, we must adapt the definition of the required proper- 
ties for penalties. 
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Definition 4.4 Assume that satisfies hypothesis Hq. LetT be a multival- 
ued Borel mapping. Let Q = Q & (T) r:y . A penalty defined on Q is a family 
(&s,t(Q))r<s<t<T of B 7 S -measurable functions on J7 r B r s -measurable bounded 
from above such that 

1. It is local: 

For all 7, n € @(T)j,, for all A E B r s , if 1aj(u,uj) = 1at]{u, u), for all 
u € [s,t[, then l A a S)t (Qr, y ) = ^Aa s ,t{Qr, y )- 

2. It satisfies the cocycle condition: 

VQ£Q,Vr<s<t<u<T, a s , u (Q) = a Sjt (Q) - T® (-a t , u (Q)) 

(55) 

Remark 4.5 Penalties could be defined for more general stable sets of prob- 
ability measures. 

The construction that we have made in [5] in the setting of (equivalent) 
probability measures solution to a martingale problem associated to a con- 
tinuous diffusion leads also to penalties in the non dominated framework. 
This will be detailed when we construct time consistent dynamic procedures 
(Section EJ. 

Recall also that one of our goals is to construct time consistent convex proce- 
dures which give rise to viscosity solutions to second order partial differential 
equations. Therefore as in [5] we are interested in continuity properties. 



5 Continuity properties for the canonical condi- 
tional probability 

5.1 A continuity property in the case of continuous paths 

Proposition 5.1 Case of C: For all u in M + and x G M n , let Q ux be 

the unique solution to a martingale problem. Assume that for some s, 
(Qs,y)yeM n ^ s weakly continuous. 

1. Then for allO < r < s for all f bounded uniformly continuous (for the 
uniform norm) on 0,^, the canonical conditional probability T® r ' x (f) : 

(w -> Q s ,x s M((/ o <( ")) = Q s ,x s (a,)((/(^*^)lx s M=x s (^6) 
is a continuous version of the Q r , x conditional expectation given B r s . 
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2. If f = g o tiT/ for some g continuous on OT, mi/i compact support. 
Let t" = inf{s,t'). Then Q s>Xs (u)((f i) 7 ^)) =/io vr[„ /or some 
continuous function h on 0£» compact support. 

Proof 

1. The map i introduced in Definition 13.81 is uniformly continuous for the 
uniform norm, it follows that for all / uniformly continuous bounded 
on CI j,, the map / oi is uniformly continuous bounded on the product 
space Cl r s x for the uniform norm. Being f oi uniformly continuous, 
for all e > there is n > such that for ||cj — u/|| < rj, ||(/o i) w — (/ o 
i) w || < e. The continuity of the map 

Q r s xlR n -> iR 

-> Q,Moi) u ) (57) 

follows then easily from the weak continuity of the family (Q s ,y)y£]R n - 
being X s continuous from f2y to M n and 7r£ continuous from f2y to fi^ , 
the continuity follows by composition. From Proposition 13.121 equa- 
tion (|56p describes the canonical regular conditional distribution. 

2. Assume now that / = go^, for some g continuous on QL with compact 
support K. 

(a) If t' < s, f is B r s measurable, and from Proposition ^, 91 T® r ' x (/) = 
/ 

(b) If s < t' , then t" = s. The maps g and ir+, are uniformly con- 
tinuous thus from 1., T® r ' x (f) is continuous and B r s measurable. 
Therefore it can be written T® r ' x (f) = ho-K r s for some continuous 
function h. The map tt : to € Cl r t , — > (^\[ r ,s] € f2£ is continu- 
ous. Thus n(K ) is a compact subspace of If w ^ 7r(i^) and 
J G fif,, Q s ,x s {w)((f{u * ^') l x a (w)=x s (w')) = 0. This proves the 
result with the support of h contained in tt{K). 

□ 

Notice that this provides a class of continuous functions stable by T . 
Notation 5.2 In case O r = C r , we denote 

Vt = {/ ° ^ui r < u < t, f continuous on Cl r u with compact support } (58) 
For all Y £ V r t , for all y G M k and s > r, T? r ' v ' (Y) belongs to V[ 
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Lemma 5.3 Let Vt be a Polish space. Let Q be a set of probability measures 
on (Q,B(Q)). Assume that Q is tight. For all f continuous bounded on C r , 
there is an increasing sequence of continuous functions with compact support 
f n such that f = lim ri _ 5 . 00 f n Q a.s. VQ 6 Q. 

Proof By hypothesis there is an increasing sequence KL n of compact sub- 
spaces of Q such that Q(/C£) < - for all Q € Q. Let <f> n be an increasing 
sequence of continuous functions with compact support, ljc n < <f> n < 1. As- 
sume that / is continuous bounded, let g = lim n ^.oo f<f> n . < ||/ — f<t> n \\ < 
I l/l I- Q{\f ~ f<fin\) — ll/ll h- From the dominated convergence Theorem, it 
follows that f = g = lim f(f> n Q a.s. VQ € Q. 

5.2 Feller property 

Definition 5.4 1. Let s in ]R + . For all x in M n , let Q sx be the unique 
weakly continuous solution to a martingale problem starting from x at 
time s. 

(Qs x)xGM n has the Feller property if for allt > s, for all f continuous 
bounded on M n , the map x — > Q e sx {f{X t )) is continuous. We denote 
itT st (f). 

2. Assume that satisfies hypothesis Hg. has the Feller property if 
every (Q s x ) has the Feller property. 

The sets constructed in section 2 have the Feller property: 

Lemma 5.5 The sets given by equation in case of continuous diffu- 
sions and by equation $15\) in case of diffusions with Levy generator satisfy 
the property Hg and have the Feller property. 

Proof The property Hg has been proved in Proposition 12.51 in case of con- 
tinuous diffusions. The map Xt is continuous, thus the Feller property is 
satisfied. In case of diffusions with Levy generator, the property Hg has 
been proved in Proposition I2.10i The Feller property has been proved in 
Proposition 12.91 

Lemma 5.6 Case of T> or C. let Q e s x be the unique weakly continuous 
solution to a martingale problem starting from x at time s. Assume that 

(Qlx) 

(z jRn has the Feller property. Then 

u G n r T ^ T st (f)(X s )(uj) (59) 
is the canonical version of the Q rx conditional expectation of f(Xt) given 
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Proof Let ifi = f(X t ), t > s. With the notations of Proposition 13.121 

^x s (u))=x a (u)'){i J o i) 7r J( tJ )(u; / ) = f(X t )(u)'). The Lemma follows then easily 
from Proposition 13.121 and the definition of T s t(f). 

Notation 5.7 Let Q be a weakly relatively compact set of probability mea- 
sures. Denote as in and -^ 1 (c) the Banach space obtained from the 
completion and separation of continuous function for the c norm c(f) = 
su PQeQ<2(l/D- 

Lemma 5.8 Let V be a set of probability measures on C([s,T],]R n ). As- 
sume that V is tight. Let T be a dense subset of [s, T}. The set of continuous 
bounded coordinates map f(Xt 1 ,...Xt k ), s < t± < ... < tk < T , ti G T and 
f G C b ((M n ) k ) is dense in L\c). 

Proof Being V tight, there is a compact subset K of tt s = C([s, T],M n ) 
such that for all PgP, P{u> s - K) < e. Let S = {f(X tl ,...X tk ), s < t x < 
... < t k < t, UET, f G C b ((]R n ) k )}. The restriction to K of elements of S 
is an algebra which separates the points of the Haussdorf compact space K. 
Thus from Stone Weierstrass theorem it is dense in C{K). This proves the 
result. 

Notation 5.9 Let < r < s < T. For all j G JN* and k G IN*, for 
all f Borelian on (M n y +k , given r < s\ < ... < Sj < s < t\ < ..tk < 
T, denote f( Sl ,.., s ,),(t 1 ,...t k ) the map defined on Q£ by f( Slr ., Sj ),(ti,...t k )(u) = 
f(X sl ,..X Sj ,X tl ,...X tk )(u). 

Proposition 5.10 Case ofV or C. For all s in M + and x G M n , let Q sx 

be the unique weakly continuous solution to a martingale problem starting 
from x at time s. Assume that for all s (<3!? x ):reiR™ has the Feller property. 
Then for all f continuous bounded (resp. Borelian bounded) on (M n y +k , 
there is a continuous bounded (resp. Borelian bounded) map f on (M n y +1 
such that for all r < s and x in M n , 

U3 G — > f((X sl (u),...,X s .(uj),X s (cj)) (60) 

is the canonical version of the Q TtX conditional expectation of fr Sli >-)g .t k ) 
given B r s , i.e. if (/( Sl ,.., Si ),(t lr ..t fc )) = fs u ..., Sj ,s 

Proof We prove the proposition for all / continuous bounded on (iR n ) J+fc . 
The result follows then for / Borelian bounded from the monotone class the- 
orem. 
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• Assume that k = 1. Let tp = f( Slj .. jS ),(ti)- With the notations of Prop 

m i {w v'w^w}(^ O ffr(w H^ , =V^.iH,".,^H,^i(^)). 

= Qs,X s (a))(l{w'| w'(s)=ai(s)}(0w(^i)) 

where </> w is the continuous function 4>u,(z) = f(X Sl (u), X s . (w), z). 
It follows from the Feller property that for given x\,...,Xj, the map 

V —> Qs,y(f(xi, ...Xj,X tl ) is continuous (62) 

We prove now that the map / : (a?i, ...Xj, y) — > Q s>y (f(xi,...Xj,Xt 1 )) 
is continuous. 

The family of probability measures (Q s ,y)yeM n on ^ s weakly con- 
tinuous thus for given K > 0, (Q s ,y)\\y\\<K is tight. Thus for all 
e > 0, there is a compact subset K, of such that for \\y\\ < K, 
Qs,y{K- c ) < e. /C is compact for the Skorohod topology, thus from 
Theorem 12.3 of [2] there is A > such that sup^/g^ l-Xf^k/)! < A. 
Let K' > 0. Due to the uniform continuity of / on the compact set 
{||^i|| < K' VI < i < j, [|xtj || < ^4}, being Q S:V a probability measure, 
for all e > there is r/ > such that for ||xj|| < K', \\x'A\ < K' and 

\\Xi - X-|| < 7], 

\Q StV (f(x 1 ,..,x j ,X tl ))-Q Sjy (f(x' 1 ,..,x l j ,X tl ))\<2(l+\\f\\)e, Vy, ||y|| < K 

(63) 

The continuity of / : (xi, .-Xk, y) — > Q s>y (g(xi, ...Xj,X tl )) follows 
then easily from ([62]) and (f63|) . 

• It follows from equation (|6ip and Proposition 13.121 that the map uj — >■ 

f((X Sl (lj), X s . (w), X s (cj)) is the canonical version of the Q,^ con- 
ditional expectation of f( si ,..,sj),(ti,...t k ) given B r s . 

• By iteration. Assume that the result is satisfied for k — 1 > 1. 
We prove it for k. It follows from the first step applied with s = 
£fc_i that there is a continuous function ^ on M^^" 1 ' such that 
■0(si,..,s ),(ti,..4 fc _ 1 )( 6t ') is the canonical version of the Q r ^ x conditional 
expectation of f[ ai ,..,sj),(ti,...t k ) given B\ k , which means that 

T t 9 k _ 1 {f( S1 ,..,s ] ut 1 ,...t k ) = ^( S1 ,..^),(t 1 ,...t fc _ 1 )- The result follows then b y 

iteration making use of the composition rule (|42p , 

□ 
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Notation 5.11 Given r < s, denote WJ the algebra of continuous coordi- 
nates maps B r s measurable. 

WJ = {/,......,, r < si < ... < 8j <s,j£ lN*,fe C b (M k )} (64) 

where 

/ Sl ,.., s >) = /((X S >),...,X S >)) (65) 

From Proposition 15.10] we deduce the following Corollary: 

Corollary 5.12 Assume that satisfied hypothesis Hq and has the Feller 
property. For all Y G W t , T e s {Y) belongs to WJ. 

6 Time Consistent Convex Continuous Dynamic 
Procedures 

In this Section the Polish space is either C r or T> r . We assume that 
satisfies hypothesis Hq and has the Feller property. The goal of this Section 
is to construct time consistent convex procedures having a Feller property, 
associated to a stable set of probability measures Q @ (T) r! y generated by 
0(r) (cf Corollary S3|). 

Proposition 6.1 Let F = {f a , a € A} be a set of l.s.c. functions uni- 
formly bounded from below on (M n ) k . 

• There is a countable subset {f an , n £ LSf} of F such that 

SUP f an = SUp f a , (66) 

• If the set F is a lattice upward directed, there is an increasing sequence 
g n of elements of F such that 

sup f a = lim g n , (67) 

Proof 

1. Let (K p ) p& ]N be the closed ball of radius p in (IR n ) k centered in 0. 
Let (0p) pG jv* be an increasing sequence of continuous functions with 
compact support contained in K p such that the restriction of 4> p to 
Kp_i is equal to 1. 
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2. Every function l.s.c. bounded from below is the limit of an increasing 
sequence of continuous bounded functions uniformly bounded from 
below. It follows then from 1 that for all a, there is a sequence g p of 
continuous functions with compact support contained in K p such that 
f a is the increasing limit of g p . Thus 

sup f a = sup g p (68) 

The set of continuous functions with compact support contained in K p 
is metrizable separable. It follows that the set {g p , a € A, p £ IV*} 
admits a countable dense subset. Thus there is a sequence a n such 
that 

sup g p = sup g p n (69) 

a<=A, pgJV* neW, pGW* 

By construction, for all n,p, g p n < f an . Thus equation (|66j) follows 
from flggP and p9l) . 

3. Let f an in F be such that equation ([66]) is satisfied. Define the se- 
quence g n by iteration: go = f ao and choose for g n +i a function in F 
such that g n +i > sup(g n , f an+1 ). The sequence <7 ra is by construction 
increasing. Let g its limit, sup agj4 f a > g > sup n£]N f an . The result 
follows from (I66p . 

□ 

We want now to construct general time consistent continuous procedures on 
C or D r . For this we introduce the notion of Feller property for a penalty. 
Recall that a penalty has been defined in Definition 14.41 

Definition 6.2 Let Q = Q®(r) r ^ y be a stable set of probability measures 
on (fT,£>50 generated by Q(T) (cf Corollary A penalty (a s ,t)r<s<t<T 

defined on Q is a Feller penalty if 

ye e e(r), 3p 9 st e c(R n ), a s , t (Q 9 r , y ) = P e Ax s ) (70) 



Remark 6.3 The above Feller property is required only for the probability 
measures Q®. y generating the stable set Q but not for all the probability mea- 
sures Qr,y (7 £ @(T)j,) in Q. From the definition of a penalty (Definition 
\4-4\ )> ^ follows that the function j5 9 st is bounded from above. We do not ask 
for boundedness. 
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Notation 6.4 Let < r < t. Recall that W[ (Notation \5A1\) is the 

algebra of continuous coordinates functions. Denote also Ct the algebra 
£-t = {f(Xt), f continuous bounded on M n }. In the following 

1. H\ denotes either W^* or Ct- 

2. Til denotes either VVf or C t , with 

VVj = {f(Xt 1 , ...Xt k ), r < t\ < .. < tf- < t, f Isc bounded from below} 

(71) 

Ct = {f(Xt) f Isc bounded from below} (72) 

The following proposition is an adaptation to this general martingale 
setting of the ideas used in the proof of Theorem 4.8 of [5]. 

Proposition 6.5 Let r < s < t. Assume that satisfies hypothesis Hg 
and the Feller property. Let T be a multivalued Borel mapping. Let a s t be a 
Feller penalty on the stable set of probability measures on (il r ,£>^) generated 
by 0(r). Let Y G W t , 

1. For all 9 G 0(T), T e s (Y) - a s>t (Q 9 r , y ) belongs to U T S 

2. For all 7 G 0(r)£ and s G [r,t[, there is n s G ©(r)J' such that 

T]{Y) - a s , t (Ql y ) < T^(Y) - a s , t (P?; y ) = Z s (73) 
and such that Tg a (Y) — a s .t{Pr,y) = Z s belongs to H T S . 

Proof Notice first that for all 7 G @(T)t the map T] is defined on all func- 
tions B T t measurable bounded from below and that if Y, Z are B T t measurable 
bounded from below, Ts(Y + Z) = T]{Y) + T] (Z). This follows from the 
linearity of T$ on bounded functions and from the continuity from below. 

1. Let 6 G 0(r). Let Y in U\, it follows from Proposition [540] that 
Tg(Y) belongs to T~L r s . If Y belongs to %l, Y is the increasing limit 
of a sequence Y n G From the continuity from below of T s e (Corol- 
lary [344]), it follows that T!?(Y) belongs to i~L T s . It follows from the 
definition of a Feller penalty (Definitions 16.21 and I4.4p that —a s t(Q 9 r ^ y ) 
belongs to ~H r s . This gives the result. 
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2. r = so < s\ < ... < s n = t be a subdivision associated to 7. For 
all u G [s n -i,s n [, j u = J2jei n -1 1 A n - 1 , J (u)8 n -ij(u, X u (uj)). For all 
j G T-n-Xi and s ^ [sn-i> *n[i from 1., there is an element Y s j ofH r s such 
that r s n " lj (y) - a S) t(Q r ^" 1,J ) = Z s = sup jeIn l Y s j belongs to 
% r s . Let B s j the measurable sets such that Z s = Yljel n -i ^sj^j' 
Let rj s G @(T) r t such that rj s (u)(u)) = Eje/„_i 1 b 3 , j X u Wn-i,j(u, X u (u)) 
for all u G [s, t]. r/ s satisfies the required conditions. 

3. For s G [sj,Sj+i[ with i + 1 < n, the result is proved downward by 
induction. 7^ = Y^jeii ^-Aiji^Oijiu, X u (oj)) Assume that Z v and rj v 
satifying equation ([73]) and Z v G % r s have been constructed for all v > 
s i+1 . For all j G I h T S *' J (Z Si+1 ) - a Syt {Qr,y) = 4>s,j belongs to % r s . 
Let B Stj G B r s such that Z s = sup JgJ . (j) s j = Y^jei^Bs^^sj- Let 
rj s G S(r)[ such that rj s (u) = rj Si+1 (u) for all u > Sj+i and rj s (u)(uj) = 

J2jeh lB s,]0id( u > X u( UJ )) f° r an u G [»>Si+i[- Vs and Z s satisfy the 
required conditions. 

Theorem 6.6 Let r < s < t < T . Let y G M n . Assume that satisfies 
hypothesis Hq and the Feller property. Let T be a multivalued Borel mapping. 
Let Q = Q e (T) ri y be the stable set of probability measures generated by G(r). 

Let (a st) be a Feller penalty on Q. Denote Ts = T s r ' v . For all Y in "HI, let 
n r s >y(Y)= sup (TJ(Y) - a S;t (Ql y )) (74) 

1. For all Y G H r t . U r s f t (Y) belongs to H r s . Moreover for all s G [r,t], 
there is a sequence Q n = Qr" y in Q, 7„ in 6(r)[ such that T s ln {Y) — 
®s,t(Qr™y) belongs to li r s , and such that lf^ y t {Y) is the increasing limit: 

YT$(Y) = lim[77«(F) - a s , t (QJ: y )] (75) 

2. LTg \ is a convex monotone map continuous from below on T-L r t with val- 
ues in T-L T S . 

3. For allr <s<t< u, for all Y G U r u , 

= K'm ,v u( Y )) ( 76 ) 
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4- In case H T t = C t , the sequence j n of 1. can be choosen independently 
ofr. 

Proof 

1. Let Y G U\. For Q\ y G Q, let Y? = l7(Y) - a s>t {Ql v ). Let Z = 
{Y? Q7,y G Q, 7 G 8(T)J [ Y s 7 G It follows from the stability by 
bifurcation of Q, from the expression of T 7 (equation (|46j) ) and from 
the locality of the penalty that -Z is a lattice upward directed. 

• If = , there is a lsc function / bounded from below such 
that Y = f(X sl ,X S2 , ■■X SI ). Let j such that Sj < s < Sj + i. From 
Proposition EIU] for all 9 G @(T), Y s e = g(X sl , ...,X Sj ,X s ) for 
some function g continuous bounded from below on (M n y +1 . It 
follows from the proof of Proposition HTol that {g \g(X Sl , X Sj , X s ) G 
Z} is a lattice of lsc functions bounded from below on (iR n ) J+ . 
The result follows from Proposition 16.11 

• In case U\ = C t , Y = f(X t ). For all 7 G e(F) r T , Y 7 = g{X s ) 
for some function g Borelian bounded from below on (JR n ) J+1 
independent of r. A similar proof as the above one proves 1. and 

4- 

2. From the linearity of Tg on bounded functions and the continuity form 
below, it follows that for all non negative real numbers c and d, , for 
all Y, Z in HI, T^cY + dZ) = cT s 7 (Y) + dTs(Z) . The convexity of 11$ 
follows. Let Y n be increasing to Y. Every T] is continuous from below 
thus II™(y) = sup 7 T s 7 (hmY n ) = sup 7i „ T 7 (Y„) = sup n IL^ (Y n ). 

3. Let Y G H T U . From 1., nJ'^(Y) belongs to H T t and we have the following 
increasing limits: 

D#(D#( y )) = lim ^ ( n *-( y )) " a *AQ^)} (77) 
lf t %(Y) = lim [jf"((Y)) - (78) 

' ft— >oo 

Fom the continuity from below of T] n , it follows that 

n$Cn#P0) = su P (r;»[r/H(^)) - - (79) 

From the stability of Q, for all n and /c, let A n fc be defined as in 
Theorem H2]i), such that T s 7 "(0) = Ts"' k (4>) for all cj) B\ measurable 
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bounded and r/ fc = T t Vfc . From the chain rule, T] n o [T t Sk ] = T s An ' fc . 
From the definition of \ n ki the- local property of the penalty and 
the cocycle condition, it follows that T s 7n [— OLt,u{Qr k y)\ ~ a s,t{Ql"y) = 
-a s ,u(.Qr"y' k )- Thus from (ESI)' ^ follows that 

K'm ,V u(Y)) = sup[T> fc (Y)) - a s , u (Q r A ;/)] < U r s %(Y) (80) 

n,k 

Conversely, Tl r s %(Y) is the increasing limit of Tp ( Y) - a s>u {Q%) . Mak- 
ing use of the chain rule for T v i and of the cocycle condition, we get 
the inequality Il r s %(Y) < II™(II^(Y)). 

4. If Y G C u Y = f(X t ). 

Definition 6.7 Let r < s < t < T. Let satisfying hypothesis Hg. let 
Q = Q 6 (T) r ^ y be the stable set of probability measures generated by @(r). 
Let (a s t) be a Feller penalty on Q. For all Y in ii r t , let 

n#(r)= sup (Tf^{Y)-a s ,{Ql y ) (81) 

One says that H r s '^ is a time consistent dynamic procedure on if a ^ prop- 
erties of Theorem \6.6\ are satisfied. 

Proposition 6.8 Let V = Q e iX)r,y Denote W+ the closure of the lattice 
vector space Wl for the norm sup^g-p Eq(\X\). Assume that for all s, and 
X G W[ , IL r s ' y t (X) belongs to W s . The procedure II sfcan be uniquely ex- 
tended to W[ . The time consistency ( equation [76|) extends to . 
In case where V is a weakly relatively compact set of probability measures 
on C([r,T],M n ), W t is equal to L x (c). 

Proof Let X, Y in Wf . From equation (|8ip . LT^ (Y) is the increasing limit of 
T7 n (Y)-a s , t (Q7%). It follows that IT/ (Y) < lf s f(X)+su Pne]N T^(Y-X). 
Changing the roles of X and Y, it follows that 

\U r s f(Y) - U r s f(X)\ <snp[T^(\Y - X\),T^(\Y - X\)] (82) 

n,k 

As in the proof of equation (|75|) . it follows from Proposition 16, II that 
supg 7g -p Ts(\X — Y|) is the increasing limit of a sequence T" n (\X — Y|). It 
follows from equation ([55]) and the stability of V that 

sup Ep{\0™ (Y) - lf s ?(X)\) < sup E P {\X - Y\) (83) 
P&V PeV 
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It follows from equation ([83]) . that U r s f can be uniquely extended to W t , 
with values in W s , equation ([76]) is then satisfied on W t ■ 
The last result follows from Lemma 15.81 

7 Construction of Feller penalties 
7.1 Penalties for continuous diffusions 

In this Section we restrict to the case of continuous paths. We consider the 
martingale problem for diffusions. In [5] we have constructed Feller penalties 
associated to probability measures solution to the martingale problem for 
continuous diffusions. In [5] the probability measures in the stable set were 
all solutions to a martingale problem with the same function a(t, x). In the 
present paper the probability measures are no more equivalent, they are even 
not dominated. The construction of the penalties that we describe below is 
the generalization of the construction that we have done in [5]. The ideas 
are the same. In this paper we chose the parameters a and b. 

Definition 7.1 O is the set of continuous bounded functions 9(t,x) = 
(a(t,x),b(t,x))) with values in M n (M)) x M n such that for all (t,x) the 
matrix a(t, x) is invertible. Let T be a multivalued Borel mapping from 
M + x M n to M n (M) x M n , 8(r) = {6 e 9, r valued}. 

For general 7 = (n, fi) E we denote P^y the unique solution to the 
martingale problem starting from y at time r constructed previously. In the 
case 7 G 0, "y(u, u) = 9{u, X u (lo)) for some continuous 9(u,x). When we 
want to emphasize the fact that we refer to continuous parameters rj and /i, 
the probability measure Pr'y will be denoted Qr',y. 
As in [5] we introduce hypothesis H g . 

Definition 7.2 Hypothesis H g 

1. g : M + x M n x (M n (M) x M n ) — > M U 00 is a "Caratheodory function 
on T" 

More precisely, g is Borelian and for all u, the restrition of g u to 
{(x, y),y G T(n, x)} is continuous (g u (x, y) = g(u, x, y)). 

2. g has polynomial growth on V 

V(t,x,y),y€T(t,x), \g(t, x, y)\ < C(l + \\x\\ m ) (84) 
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3. g is bounded from above on T which means that g is bounded from 
above on {(t,x,y), y G T(t, x)} 

This last condition on T which was not present in [5] could be suppressed 
with a little more work. 

Recall that from Corollary OJ the set Q e {T) r , y = {Q? >y , 7 G G(T) r T } is 
stable. 

Proposition 7.3 Let T be a multivalued Borel mapping. Let ®(T) be as in 
Definition al Assume that g satisfies Hypothesis H g . Let t > 0. 

1. For all 6 = (a, b) G 0(T), there is a real valued continuous map (s, x) G 
[0,t] x M n -> Lt' b (g)(s,x) such that 

Qs'ii f g(u,X u ,9(u,X u ))du) = Lf(g)(s,y) Vs G [0,t] and ye M n 

(85) 

2. For allO <r < s <t and all y G M n , for Q = Q{$, 

T?[- [ g(u,X u ,e( U ,X u ))du] = -L a t '\g)(s,X s (oj)) (86) 

J s 

Notice that for all y G M n L^' b (g)(t,x) = 

Proof 1. is an application of the first statement of Proposition 4.2 of [5j 
2. —g is bounded from below, so making use of the extension of defined 
on Corollary 13.141 it follows that 

T?[- f g(u,X u ,e(u,X u ))du] = Qj5t sH [- f g(u,X u ,e(u,X u ))du] 

J s J s 

-Lf(g)(s,X s (cj)) (87) 
We define now the penalty of every probability measure Qr, y in Q,®(T) r ^ y . 
Definition 7.4 For all Qr,y, for all r < s < t < T , we define the penalty 

t 

asAQly) = ~ T s{- J 9{u,X u {u)^{u,uj))du] (88) 

s 
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Corollary 7.5 The above definition provides a Feller penalty according to 
Definitions \4-4\ and \6.2[ 

Proof It follows from hypothesis H g that for all r < s < t, the func- 



tion — J g(u, X u {ui) , 7(1*, u))du] is B[ measurable bounded from below, thus 



from Corollary 13.141 a Sj t(Q7,y) is B r s measurable bounded from above. The 
cocycle condition for ac s t(Qr,y) follows from the chain rule for T 7 ( Corollary 
I3.14j) and the additivity of T] on functions bounded from below. The local 
condition follows from the Definition of the penalty. The Feller property of 
the penalty follows from Proposition 17.31 

7.2 Penalties for diffusions with Levy generators 

In this Section we consider probability measures on the Polish space T> r of 
cadlag paths endowed with the Skorhokod topology. The notations are those 
of Section E31 

Definition 7.6 1. Let C > 0. A4c denotes the set of a -finite measures 
fi on M n — {0} such that 



2. is the set of (a, b, M) such that 

• a,b are continuous bounded functions on JR + x M n , with values 
in M n (M), ]R n , and for all (t,x) a(t,x) is invertible. 

• M satisfies hypothesis Mq (Definition \2.6\) . i.e. for all (t,x), 
M(t,x) € M-c- Furthermore for all Borelian subset A of W 1 — 



is a continuous bounded function of (s,x). 

3. A4 C is endowed with the weak topology. Let T be a closed convex mul- 
tivalued Borel mapping from M + x M n to M n (M) x M n x M c - Let 
9(r) = {9 G G, r valued}. 

We want now to define the penalty of every probability measure Qr, y in 
Q e (r) rir Recall that Q r T is described by Definition ED For all 7 G Q(r)^, 
write j(u,uj) = (n, A, fi)(u,u), where 77 takes values in M n (lR), A in M n and 
\i takes values in M. c . 




(89) 



{0} 




(90) 
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Definition 7.7 Let g be a real valued function on M + x M n (JR) x M n x M.q 
such that for all 9 = (a, b, M) G @(T) ; g 9 (u, x) = g(u, x, a(u, x),b(u, x), M(u, x) 
is continuous bounded. We define the penalty 

t 

a s,t(Qr,y) = T 7i / g(u,X u (u),ri(u,u)),\(u,u>),ii(u,u)))du] (91) 



Proposition 7.8 The above definition provides a penalty according to Def- 
inition \4-4\ The penalty is a Feller penalty (Definition \6.2\) . More pre- 
cisely, for all 9 = (a, b, M) G ©(T), there is a continuous function Lf(g) on 
[0, t] x ]R n such that Vs G [0, t] and y G M n , 

Qsi' M ( y"^(«,X u H,a(n,X4a;)),6( U ,X u H),M( U ,X4a;))dn = L t e ( 5 )( S ,y) 

(92) 

For allO <r < s <t and all y G M n , for Q = Q a r § M , 

T?[ [\(u,X u (u),a( U ,X u (u)),b(u,X u (u)),M(u,X u (u))du} = L e t {g)(s,X s (uj)) 

J s 

(93) 



Proof 

1. It follows easily from the hypothesis, and the description of 0(r)j> 

(cf Definition 13 . 1|) that for all 7 = (77, A,//) G @(r)^, the function 

t 

f g(u, X u (uj), rj(u, uj), A (it, u), fj,(u, u>)) is B\- measurable bounded. From 

s 

Proposition 13.131 it follows that a s> t(Qr,y) is B r s measurable bounded. 

2. The cocycle condition follows easily from the definition of the penalty 
(|9ip . the linearity for T 7 and the chain rule for T 7 . 

3. locality Let 7, rj G 0^, for all A G B r s , if Iai{u,uj) = 1^77(^,0;), for all 
u £}s,t]. from Proposition 13.131 equation (ji6|) . T s 7 and coincide on 
bounded variables B\ measurable. The locality follows then from the 
definition of the penalty. 

4. Let 9 G @(r), 9 = (a,b,M), a,b are continuous bounded functions 
of (u, x), and M satisfies hypothesis Mc- Let e > 0. Let K such 
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that equation (|10p is satisfied for all < r < t and ||y|| < D. The 
function g 9 is bounded and uniformly continuous on [0,T] x {||x|| < 
K}. Making use of equation (jlip and of arguments similar to those of 
Proposition 12.91 it follows that for all s' < t, there are s' < t\ < ti < 
■ ■■ < tk < t and a continuous bounded function f s t t on (IR n ) k such 
that for all ||y|| < D, for all < r < s', 

t 

QrS' M (\ J g d {u,X u (u))du - f s ,, t (X tl ,X t2 ,..X tk )\ < e (94) 
s' 

From Proposition ^. 9\ there is a continuous function / s / t on [0, s'] x M n 

such that Qr;y M {f s ',t{X tl , X t2 , ..X tk )) = f s ' jt (r, y). It follows from dMD 

t 

that Q°r]y (J g 6 (u, X u (uj))du is the uniform limit on [0, s'\ x {||y|| < 

s 

D} of a sequence of continuous functions. It is thus continuous. The 
function g being bounded, the continuity on [0, t] x M n of the function 
Lf defined by equation (|92p follows then easily. Equation (|93p follows 
from Proposition 13.121 

8 Feller property of the time consistent dynamic 
procedure 

In all the following we restrict to the case of continuous diffusions or dif- 
fusions with Levy generator. The notations and hypothesis are those of 
Section [71 We prove now that with the specific choice for the penalty which 
was made in Subsections 17.11 and 17.21 the procedures H r s '^ that we have 
constructed for all given r and y are strongly connected and have a Feller 
property. We introduce now a larger set of parameters: 0(r)^. The defini- 
tion of @(r)^ is similar to the definition of @(T) r T (cf Definition 13. ip . but 
now the set Iq is a finite set and not necessarily a singleton. Every element 
7 of ©(r)^, satisfies equation (fT6|) . For 7 £ 0(r)^, the process (Zr, u )r<u<T 
is defined by equation (fTTj) . 

Remark 8.1 Let < s < t. Let x G M n . Let 7 G G(r)f. The sets 
Aoj,j G Iq belong to the a -algebra generated by X s and form a partition 
of Q r t . It follows that there is j x G Io such that {X s (u) = x} C Aqj x . 
Therefore a probability measure Q on (Q s ,Bf) is solution to the martingale 
problem {Z2 )U )s<u<t starting from x at time s (Definition \2. 3\) if and only if 
Q is solution to the martingale problem {Z2%) s < u <t starting from x at time 
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s, where {^ x ){u,ui) = 9oj x (u, X u {uj)) for all s < u < si, and (^f x )(u,oS) = 
j(u,u) for all si < u. Thus 7 X belongs to 0(r)f. 

The following proposition is a more precise version of Proposition 16.51 

Proposition 8.2 Let h be a continuous function on M n bounded from be- 
low. For all 7 G @(r)[ there is a continuous function K 1 on [0, t] x M n 
bounded from below and for all r < s < t, there is r/ s G 9(r)f such that 

1. 

Vx G M n , if" 1 (h(X t )) - a s , t (P^%) = fC(s, x) (95) 

There is a partition Bj of W 1 in Borelian sets, and rf s £ 6(r)f such 
that 

Vx G Bj, Ts°' x (h(X t )) - a Sit {Pfy = h?{s, x) (96) 
Vx G Bj, h ni (u, x) = h" t (u,x), Vs < u < t (97) 
2. For all i] G 0(T)l whose restriction to [s,t] is equal to rj s , 

Vy G M n , T s P ^(h(X t ) - a s , t (P* y ) = W(s, X.) 

Tf< y {h(X t )) - a S!t (Ql y ) < T P ^(h(X t )) - a s>t (P? >y ) 

/i 7 (u, x) = h v (u, x) Vs<u<t (98) 

Proof 

• Step 1: Let 6 G 9(r), let h e be the function defined on [Q,t] x M n by 

Ts l *(h{X t )) - a s , t {Pl x ) = h e (s,x) (99) 

The continuity of the map h e on [0, t] x M n follows from Theorem 7.1 
of [33] (see Proposition 2.7 of [5] for details), and from Proposition 
17.31 in case of diffusions. In case of diffusions with Levy generator, the 
continuity of h e follows from Propositions 12.91 and 17.81 Equation 

V0<r <s<t,Vy £M n , T^' v (h(X t ))-a s , t (P^ y ) = h\s,X s ) (100) 
follows then from Lemma 15.61 Propositions 17.3 1 and 17.81 
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• Step 2: The proof of the existence of K 1 and rj s satisfying (|98p fol- 
lows the proof of Theorem 4.8 in [5]. We sketch the proof. Let 
r = so < s\ < ... < s n = t be a subdivision associated to 7. For 
it G [si,s i+1 [, 7(u,w) = ^2 jeI .lA itj (^)0i,j(u,X u (u;)), 0y G 6(T). b? 
and ?7 S are defined recursively. Assume that li 1 is defined and contin- 
uous on x M n , and that r\ u is defined for u G [sj+i,i]. Let hij 
be the continuous function on [sj,Sj + i] such that Vs G [sj,Sj + i], 

Vx G rf" (/^(s i+ i,X fli+1 )) -a SjSi+1 (P s % 3 ') = hi d (a,x) (101) 

For Sj < s < Si + i, let /i 7 (s,x) = sup je/ . hij(s,x). Given s G [sj, 
there is a Borelian partition -Bj,j G Ii of iR n such that /i 7 (s,a;) = 
Sje/, ' i -B j (x)hi ) j(s,x). Let r) s (u,w) = rf s (u,uj) = r/ Si+1 (u,uj) for u > 

Let 7^ (it, a;) = 6ij(u,X u (uj)) andr/ s (u,w) = Y^j ^B j (X s )9 i j(u,X u ( 
for s < u < Sj-fx- We end the proof of i. making use of the expression 
of T s r,v , cf Theorem 13.131 and of Remark 18. 1[ Notice that r\ r belongs 
to 8(1% 4 G 9(r)f and Vs G 8(r)f 

Q7 Pr 

• Step 3: It follows from Step 1, from the expressions of T s r ' v , T s r,v , 
and the properties of the penalty that the construction given above 
leads to h 1 and rj s such that equation ([98j) is satisfied for all rj G 9(T)l 
whose restriction to [s,t] is equal to r] s . 

□ 

Theorem 8.3 1. Let < r < T. Let VV^ be the cone of coordinate 
functions f(Xt 1 ,..Xt k ), f lower semi continuous bounded from below 
(Notation \6.4\ ). Let (^~ s 't)r<s<t<T be defined on VV^ by 

D#Q0= 7 sup (Tf- (Y) - a s , t (Ql y )) (102) 

where a Sj t is the penalty constructed in Section^ Then (Jl r s ,y ) r <s<t<T 
is a time consistent convex dynamic procedure on W£ . 

2. Lt has the following Feller property: For all h lower semi continuous 
function on JR n bounded from below, there is a lower semi- continuous 
function h bounded from below on [0, t] x M n such that 

Vx G M n , n. s s >t(h(X t )) = h(s, x) (103) 
V0 < r < s < t, Vy G M n , U r ; y t (h(X t )) = h(s, X s ) (104) 
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Furthermore for all given r and y, for all r < s < t, there is a se- 
quence r] n £ @(r)[ such that U r s '^.(h(Xt)) is the increasing limit of 

(T s P ™(h(X t ))-a s , t (P%)) 

Proof It follows from Corollary 17.51 and Proposition 17.81 that a is a Feller 
penalty. Thus from Theorem l6.6t and Definition [621 n^' f is a time consistent 
convex dynamic procedure on W[ . 

With the notations of Proposition [821 let h = sup 7e0 ( r )o h 1 . From equation 
([97]) . it follows that for all s and all < r < s, 

sup h y (s,x) = sup hP(s,x) (105) 
7 £8(r)j r,ee{vy t 

It follows from Proposition 18.21 and equation fllQ5f> that Vr < s < t, 
Tf s 'V(h(X t )) = sup (T? 7 -(h(X t ))-a s , t (Ql y )) 

= sup h v (s,X s ) = h(s,X s ) (106) 

r,G6(r)[ 

The last assertion follows from Theorem 16.61 

9 Viscosity solution 

The pocedures are the procedures constructed in the previous Section in case 
of Diffusions with Levy generator or in case of continuous diffusions. From 
now on, one assumes furthermore that T is a multivalued Borel mapping 
convex and closed valued. 

9.1 Viscosity supersolution 

One assumes that for all K large enough, Tk is lower hemicontinuous (cf 
Definition 16.2 in [T], where Tx{t,x) = {(a,b,fi) G T(t,x), \\a\\ < K, \\b\\ < 
^/jRn_{o}[IMI 2l |M|<i + WvWhyWyildKy) < K} in case of diffusions with 
Levy generator (and r^(t,x) = {(a, b) £ T(t,x), \\a\\ < K, \\b\\ < K in case 
of continuous diffusions). Let (t ,x ) G [0,t[xM n . Let (p G C fe 1,2 ([0,£] x lK n ) 
such that 

= v(t ,x ) - <j>(t ,x ) = mm(v(t, x) - <j>(t, x)) (107) 
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Lemma 9.1 Let £ C^' 2 ([0,t] x M n ). Assume that M satisfies the hypoth- 
esis Mq of Definition \ 7. 6] Let 



y*\l d>( s x) 

K<j>(s, x)(y) = <f>(a, x + y)- <j>(s, x) - \ \ ' (108) 

1 + \\y\\ 

The function K(p(s,x) = f ]Rn _^ y K<fi(s,x)(y)M(s,x,dy) is a continuous 
function of (s,x). 

Proof The functions K(f>(s, x) given by (|108p are uniformly bounded. Thus 
for all e > 0, there is K > such that for all [i € A4c (Definition 12, 6p . 



V(s,x), / K<j>{s,x)(y)ii{dy) <e (109) 
J\\v\\>k 

It follows from the Taylor formula with integral remainder that K(p(s, x){y) — 
k<f>(ao,x )(y) = y*(V{<j>){s,x) - V(0)(s o , *o))ig^ + £ Tr(D 2 0(s, x + 
uy) — D 2 4>(sq,xq + uy))yy*](l — u)du. Let K > 0. Making use of the 
uniform continuity of (s,x) — > V(f)(s,x) and (s,x) — > D 2 4>{s,x) on com- 
pact spaces it follows that for \s — sq\ < rj, \\x — xq\\ < rj, \\x\\ < Kq and 
Ikoll < K Q , f\\ y \\< K \K(j){s,x,y) - K(j){sQ,XQ,y)\ < f M < K e\\y\\ 2 (i(dy) for all 
fj, € M.c- Thus Jjj7i_{ } \K<t>{s,x,y) — K<P(sq, XQ,y)\(j,{dy) tends to uni- 
formly in fjL € A4c when (s,x) tends (sq,xq). On the other hand, making 
use one more time of the Taylor formula and of the continuity hypothe- 
sis (Definition 17.61 2.). it follows that j ]Rn _^K<f>(so,xo,y)M(s,x,dy) is a 
continuous function of (s, x). □ 

Theorem 9.2 The hypothesis are those of Theorem \8.3i Assume also that 
for K large enough, Tk is lower hemi continuous. Let h be continuous 
bounded from below. Let v = h be a lower semi continuous function such 
that equations 11103]) and |1 ft^| ) are satisfied. In case of Levy diffusions v is 
a viscosity supersolution of 



— d u v(u, x) — f(u, x, Dv (u, x), D 2 v(u, x), Kv(u, x)) = 

v(t,x) = h(x) 

(110) 

at each point (to,xo) such that f(to, xq, D(p(to, xq), D 2 <ft(to, xo), K<j){tQ, xq))) < 
oo for all cj) 6 C^' 2 satisfying jl07\ ). Here f(t, x, D<fi(t, x), D 2 <p(t, x),K(f)(t, x)) = 

[(b*D<t>(t, x)+iTr(aL» 2 </)(t, x))+J K<f>(t, x){y)^dy)-g{t, x,a,b,fj,)], 
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and K(fr(t,x)) is given by equation t!08\) 

In case of continuous diffusions, assume that the restriction of g to {(u,x,y), y £ 
T(u,x)} is upper semi- continuous. Then v is a viscosity supersolution of 



— d u v(u, x) — f(u, x, Dv(u, x), D 2 v(u, x)) = 

v(t,x) = h(x) 

(111) 

at each point (to,xo) such that f(to, xo, D(j)(tQ, xo), D 2 <ft(to, xo)) < oo for all 
4> £ Cl' 2 satisfying jl07\ )- In this case 



f(t,x,z,i)= sup [(b*z + -Tr(aj) - g(t,x,a,b)] (112) 
{a,b)eT(t,x) 1 



Proof The proof follows the proof of Theorem 5.9 of [5], replacing Ito's 
formula by the martingale property. From the time consistency for the 
process Ilu t f , for all 5 > 0, 

v(t ,x ) = DgfW**)) = Kft° + sK'+s,MX t ))) (113) 
From the definition of v and the inequality v > (f), it follows that 

nl° Q >*l t (h(X t )) = v(to + 6,X to+s ) > <p(t Q + 5,X t0+s ) (114) 
From the definition of rL*°'^° +(5 , it follows that for all 6 G 6(r), 

v(t ,x ) > Qt , xo (v(t + 6,X to+s )) - a t(hto+s (Q e t0)XO ) (115) 

• We give details in case of diffusions with Levy generator. Let K(f>(s, x) 
be given by equation (|108p . The function <f> belongs to C^' 2 . Thus it 
follows from the martingale property for Q$ XQ as stated in Theorem 
1.1 of [32] , from the definition of the penalty (Definition 17. 7p and the 
equality v(to,xo) = 4>(to,xo) that 

> Q e t0 , X0 [Jt° +S {d u (l>(u,X u ) + iTr(aD 2 </>)(n,X u ) + b* D^u, X u )]du 
+Qt ,*o [(ItT 5 X m X u ),b(u, X u ),M(u, X u )du] (116) 
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/(to, x , D(f)(t , x ),D 2 4>(t ,x ),K(t>(to, x )) = sup (aiMgr(io :Eo) [b*D<j)(t , x )+ 
\Tr(aD 2 <j)(t , x ))+ f M n_ {0} K(j)(t ,x ){y)^(dy)-g(to,xo, a, b, /i)]. Let 
(ao, &o, Mo) G r such that 

(b^D(j)(to, x ) + \Tr(aoD 2 cj){to, x )) + / #<K*o, £o)d/«o - s(*o, #0, a , 6 , Mo)] 
> /(*o, so, -D<K*o, x ), D 2 (j)(t , x ),K(f)(t , x )) - e (117) 

Let K such that (ao,&o,Mo) S L^ and Tk is lower hemicontinuous. 
There is then a continuous function (s, x) — > a(s, x), b(s, x), M(s, x)) = 
9°(s,x) G such that a(s ,xo),b(so,xo),M(s ,xo) = (a ,6 ,Mo)- 
From the regularity properties of (p and from Lemma f9.ll one can write 
dBll as 



0>Q 6 t o , Xo [[ {i{u,X u )-g e \u,X u ))du (118) 
where £ and <7 e ° are continuous bounded. 



• In case of continuous diffusions, it follows from equation (|115p that 

> Q 9 t0)XQ [ [ t0+ \^u,X u )-g(u,X u ))du (119) 
J t 

where £ is continuous bounded and g is upper semi-continuous. 

For all e > 0, there is 77 > 0, such that for to <u<t<to + rj and 
1 1 xo — #|| < "Hi 

£(u, x) - g(u, x) > £(t , x ) - g(t , x ) - e (120) 
with g equal g e ° or g. In case of Levy generators, let Kq = 1 1£| |oo + I \g e ° 1 



00 • 

m 



In case of continuous diffusions, from hypothesis H g , \g(u,x)\ < 1 + ||x 
Let Kq = WZWn + 1 + (Q e t ? hXO (sup t0 < u < v ||X„|| 2m )i 

From Lemma 12.71 in case of Levy generators and from Proposition 2.3 
of [5] in case of continuous diffusions, applied with the probability measure 
Qto,x there is < 5 < rj such that 

Qtox ( A ) < 4~ with A = i U} I SU P ll-^u-aroll >»/} (121) 

^0 t <u<t +8 

Dividing the inequality (|116|) by S, making use of (|117p . (j!20p . (|12ip and of 
Cauchy Schwarz inequality, it follows that 

> /(t , x , D(/>(t , x , D 2 cj)(to,xo)k(j)(to, x )) - 3e 

□ 
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Remark 9.3 A different approach to viscosity solutions of fully non linear 
PDE is proposed in f31^ . This approach is based on the existence of solutions 
to BSDE. In J22F the PDE is 

—d u v(u, x) — f(u, x, v(u, x), Dv(u, x),D 2 v(u, x)) 

with f(t,x,y,z,j) = sup a [^Tr(a^f) — g(t,x,y, z,a)], f is allowed to depend 
on y. However unlike for equation \112\) , the assumptions on function g 
(Assumption 5.1 of fSltf ) are quite restrictive: the domain of g(t,x, .) is 
independent oft andx, the function g is uniformly continuous int, Lipschitz 
in z. 

9.2 Viscosity subsolution 

From now on we add a new hypothesis H' . In case of continuous diffusions we 
assume that the multivalued Borel mapping T has linear growth, i.e. There 
is a constant K > such that V(a, b) G T(s, x), \\a\\,\\b\\ < K(l + \\x\\). As 
in [5] Lemma 5.11, it follows from |21j II 5 Corollary 10 that for all q > 1, 
C, and t > 0, there is a constant K\ such that for all y such that \\y\\ < C 
and all bounded 7 £ 6(T)£, 

E Q7y ( sup (||X t - X u \\ 2 i) < K x {t - sf (122) 

s<u<t 

and 

Ve > 0,V?? > 0,3/i > OVr > 0,Vy,||y|| < C, V7 € 9(1% QJJ sup \\X v -y\\ > r/) < e 

r<v<r+h 

(123) 

Denote v* the upper semi continuous envelope of v, 
v*(s,x) = limsup v(s',x') 

(s',x')— >(s,x) 

Let 4> ^ Cl' 2 sucn ^ na * 

= v*(t ,x ) - 4>(t ,x ) = sup(v*(s,x) - <j)(s,x)) (124) 

(s,x) 

Theorem 9.4 Let h be continuous bounded from below. Assume that 

1. In case of continuous diffusions, g satisfies hypothesis H g and V is 
closed convex with linear growth. 
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2. In case of diffusions with Levy generator, V = Tk for some K > 0. 

Assume that f is upper semi continuous. Let v = h be the lower semi 
continuous function as in Theorem \8.3l Then v* is a viscosity subsolution 
°f (GP i n case of continuous diffusions and of M1U\) in case of diffusions with 
Levy generator 

K(j)(u, x) belongs to the vector space C(M n ) of continuous functions on M n . 
Let M. be the vector space of measures generated by Mc- The topology on 
E is a(E, M). 

Proof It follows from the first part of the proof of Lemma 19.11 that K(f> is 
continuous from [0, T] x M n to E. The functions 4> u ,D(j), D 2 cp are continuous 
and / is upper semi-continuous thus for all n > there is r\ n > such that for 
to < u < to+rj n , and | |s— a?o 1 1 < Vn, <j>u(u, x)+f(u, x, Dcj)(u, x), D 2 (/)(u, x),K(j)(u, x) < 
<t>u(to , Xq) + /(t , x , D<f)(t , s ), E> 2 (p(t Q , x ),K</>(t , x ) + ~. From equation 
(|123|) in case of continuous diffusions and inequality (jllj) in case of diffu- 
sions with Levy generator, there is a n > such that for all \u — 4q| < 1 and 
111/ - soil < 1 for all 7 € 8(T)£, 

QZ, y ( A n) < ~ with A n = {u | sup \\X U < - y\\ > } 

u<u'<u+a n * 

Let 5 n = inf(j] n ,a n ). For all n > choose (t n ,x n ) such that \t n — to I < 
||s n — xo|| < % and (f){t n ,x n ) — v(t n ,x n ) < For all n > 0, there is a 
process 7„ € 0(r)/% such that 

u(tn,x„) < E Q]n (h(X t )) - a tn>t {QJl Xn ) + \. (125) 

From the cocycle condition for the penalty associated to the probability 
measure Q%, Xn , the definition of IT^^pQ) and U t+l,M X J = 
5 n ,X tn+Sn ) < (j)(t n + 5 n ,X tn+Sn ) 

rtn+Sn 

v(t n ,x n ) < E Q i n [<f>{t n + 5 n ,X tn+Sn ) - / g(u,X u ,fi n (u,uj)du} + - 

(126) 

We apply the martingale property for Qj 7 ™ and we make use of the def- 
inition of /. We can then finish the proof as the proof of the viscosity 
supersolution. 

9.3 Viscosity solution and uniqueness 

The following Theorem results from Theorems 19.21 and 19.41 
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Theorem 9.5 Assume that all the previous hypothesis are satisfied. As- 
sume furthermore that h is bounded from below and a Holder- continuous 
for some a > in case of continuous diffusions and h is Lipschitz in case 
of diffusions with Levy generator. Let v = h be a lower semi continuous 
function such that equations MU'J\) and are satisfied. Assume that the 

PDE Iill0\) satisfies the comparison principle for functions bounded on com- 
pact spaces. Then the function v is continuous. It is the unique viscosity 
solution of U10\) . 

Proof As in [5] we prove first that v is continuous at (t, x) for all x. Making 
use of the equation A122 j> in case of continuous diffusions and of Lemma 12.71 
for diffusions with levy generator, we prove as in [5] that —v(s, x) — h(x) 
tends to uniformly in x when s tends to t. The result follows then from 
Thm l9T2l and 19.41 and from Proposition 5.5 of [5]. For comparison results for 
non linear second order PDE we refer to [17\ [T4"l [9] . 
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